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Abstract 

In the course of Darwinian evolution of a population, punctualism is an important 
phenomenon whereby long periods of genetic stasis alternate with short periods of 
rapid evolutionary change. This paper provides a mathematical interpretation of 
punctualism as a sequence of change of basin of attraction for a diffusion model of the 
theory of adaptive dynamics. Such results rely on large deviation estimates for the 
diffusion process. The main difficulty lies in the fact that this diffusion process has 
degenerate and non-Lipschitz diffusion part at isolated points of the space and non- 
continuous drift part at the same points. Nevertheless, we are able to prove strong 
existence and the strong Markov property for these diffusions, and to give conditions 
under which pathwise uniqueness holds. Next, we prove a large deviation principle 
involving a rate function which has not the standard form of diffusions with small 
noise, due to the specific singularities of the model. Finally, this result is used to 
obtain asymptotic estimates for the time needed to exit an attracting domain, and to 
identify the points where this exit is more Hkely to occur. 
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1 Introduction 

The Darwinian evolution of an asexual population is controlled by demographic (birth and 
death) rates, which are typically influenced by quantitative characters, called phenotypic 
traits: morphological traits like body size, physiological traits like the rate of food intake, 
life-history traits like the age at maturity. Such traits are heritable yet not perfectly trans- 
mitted from parents to offsprings, due to mutations of genes involved in their expression. 
The resulting variation of traits is then exposed to selection caused by ecological inter- 
actions between individuals competing for limited resources. Models of evolution of the 
dominant trait in the space of phenotypic traits are usually of two types: jump processes 
(often called "adaptive random walks" [MKE]) or diffusion processes ([2ZII22])- Diffusion 
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models are usually more suited to finite populations, weak selection, or long time scales. 
These models usually involve a so-called "fitness function", which quantifies the selective 
ability of each possible phenotypic traits. Such models are also sometimes referred to as 
evolution models on a "fitness landscape" (an notion going back to Wright [35,]) • 

In most cases, the parameters of these models (speed of evolution, fitness function,. . . ) 
are based on heuristic considerations. However, since the early 1990's, adaptive dynamics 
theory [23l [28l [2^ has been developed to give a firm basis to such models, starting from 
an individual-based description of the population with explicit ecological interactions. The 
combination of ecology and evolution allowed to obtain evolutionary models on a fitness 
landscape that depends on the current state of the population, and which is explicitly given 
in terms of individual parameters. The first model is an adaptive random walk, called the 
"trait substitution sequence" (TSS), first described in [3^ (see also [T3]). The mathematical 
derivation of this model from an individual-based model under specific asymptotics has 
been done in [6]. In the limit of small mutations, this stochastic jump process converges 
to a deterministic ordinary differential equation called "canonical equation of adaptive 
dynamics" [ISJ [3,110]. Several diffusion models have also been obtained in this framework [H 
[9], either as diffusion approximations of the TSS or in the case of weak selection in finite 
populations. 

One evolutionary pattern that remains poorly understood among biologists is that 
of "punctualism": the phenomenon of Darwinian evolution whereby long periods of trait 
stasis alternate with periods of global, rapid changes in the trait values of the population, 
which can be due to a large mutation or to successive invasions of slightly disadvantaged 
mutants in the population [32]. In this paper, we interpret punctualism as phases of quick 
changes of basin of attraction for the canonical equation of adaptive dynamics, separated 
by long phases where the population state stays near the evolutionary equilibrium inside 
the current basin of attraction ("problem of exit from a domain" [2T]). The TSS model is 
not well-suited to this study because it cannot jump in the direction of less fitted traits 
(i.e. traits having negative fitness). However, for punctualism to occur, a sequence of 
surviving unfitted mutations must occur. This is possible on long time scales because of 
the finiteness of the population. Therefore, we focus in this work on a diffusion model 
of adaptive dynamics that generalizes the one of [8] (see [5j for a general derivation of 
these models), where evolution can proceed in any direction of trait space. This model is 
obtained as a diffusion approximation (in the sense of [20l Ch. 11]) of the TSS. 

This diffusion process on the trait space, assumed to be a subset of W^, is solution to 
the the following stochastic differential equation, with coefficients explicitly obtained in 
terms of biological parameters (see section [21): 

dXf = {b{Xf) + eb{Xl))dt + ./Ia{Xl)dWu (1-1) 

where h{x) and h{x) are in M"^, a{x) is a d x d symmetric positive real matrix, and e > 
is a small parameter scaling the size of mutation jumps. 

The main difficulty of this model is that the standard regularity assumptions for 
stochastic differential equations (SDE) are not satisfied: the function b is (globally) Lip- 
schitz, but h is discontinuous at isolated points of the trait space, called evolutionary 
singularities, and a is not globally Lipschitz, but is only l/2-H61der near the set T of 
evolutionary singularities. Moreover, b{x) = h{x) = (7{x) = for x G F. 
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Despite these difficulties, we are able to study the existence, strong Markov property 
and (partly) uniqueness for this SDE, to prove a large deviations principle (LDP) as e — > 0, 
and to study the problem of diffusion exit from a domain of Freidlin and Wentzell [21| . 
which is the key question for punctualism: what are the time and point of exit of from 
an attracting domain? 

The original method for proving a LDP for the solution to a SDE with Lipschitz coef- 
ficients was based on discretization and continuous mapping techniques [2TJ [2] (transfer of 
the LDP for Brownian motion — Schilder's theorem — to the LDP for the diffusion). This 
technique has been extended to weaker assumptions on the coefficients (e.g. essentially 
locally-lipschitz in j3] or for a restricted class of two-dimensional diffusions in [26]) or to 
reflected diffusions \W\. Other techniques were more recently developed to study LDP 
for diffusions with irregular coefficients. The weak convergence approach of Dupuis and 
Ellis [IH] is based on a combination of perturbation approach, discretization and represen- 
tation formulas. They were in particular able to obtain upper bounds under very general 
assumptions [19] and to obtain the LDP for diffusions with discontinuous coefficients [4] 
(see also [H]). Another technique developed by de Acosta [T], is based on an abstract non- 
convex formulation of LDP, and allows one to deal with degenerate diffusion coefficients, 
but requires Lipschitz coefficients. 

However, the existing results dealing with discontinuous coefficients are of a different 
nature as the singularity we consider (in [III 1^, the drift coefficient is discontinuous on 
a hyperplane), and these later methods require either the coefficients to be Lipschitz, or 
the diffusion parameter to be non-degenerate. Another reason why these methods seem 
not to apply easily to our situation is that the rate function arising naturally with these 
methods does not take into account the singularity of our model. Actually, the results 
of [in] can be used to obtain an large deviation upper bound, but, as appears in Section (H 
with a non-optimal rate function. For these reasons, we adapt in this work the original 
methods based on discretization and path comparisons, allowing us to finely study the 
paths of the diffusion near F. Our proof follows the method of Azencott [2] (see 
also [16]). Interestingly, it also appears that, in contrast with what is usually observed in 
large deviations theory (see e.g. [E]), our upper bound is more difficult to obtain than the 
lower bound. 

The paper is organized as follows. In Section [21 we describe precisely the model and 
study the regularity of the parameters a = aa* , b and b. In Sections l3 . II and [3?2l we estab- 
lish strong existence and the strong Markov property for (jl.ip . by explicitly constructing 
a solution until the first time it hits F, and next setting X'^ constant after this time. Be- 
cause of the bad regularity properties of b and a, uniqueness is a difficult problem. We are 
only able to prove pathwise uniqueness under the assumption that a.s. never hits F, 
and we give in Sections 13.31 and 13.41 explicit conditions ensuring this assumption and other 
conditions ensuring the converse. In section lU we prove the main result of this paper: a 
large deviation principle for X^ as e ^ 0. Finally, in Section [5l we apply this result to 
the problem of diffusion exit from an attracting domain. We obtain a lower bound for the 
time of exit and we prove that the exit occurs with high probability near points of the 
boundary minimizing the quasi-potential. 
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2 Description of the model 



We assume for simplicity that the space of phenotypic traits is for some d > I (this 
may appear as a restrictive assumption, however see Remark l2.ll below). The coefficients 
b, b and aa* = a of the SDE (|l.ll) are functions on W^, explicitly given in terms of two 
biological parameters: the fitness function, and the mutation law. In this section, we first 
define these parameters, and then study their regularity. 

2.1 The fitness function 

The function g{y, x) from x M'^ to M is the fitness function, which measures the selective 
advantage (or disadvantage) of a single mutant individual with trait y in a population with 
dominant trait x (see [30j[6]). If g{y,x) > (resp. g{y,x) < 0), then the mutant trait y is 
selectively advantaged (resp. disadvantaged) in a population of trait x. With this in mind, 
the fact that the fitness function satisfies 

g{x,x)=0, yxGW^ (2.1) 

is natural (a mutant trait with trait x is neither advantaged nor disadvantaged in a popu- 
lation with the same trait). 

When g is sufficiently regular, we will denote by Vig the gradient of g{y, x) with respect 
to the first variable y, and by Hi jg the Hessian matrix of g{y, x) with respect to the i-th 
and j-th variables (1 < i,j < 2). 

We introduce the sets 

r = {x G M'' : Vigix, x) = 0}, (2.2) 
and Va>0, Tc, = {x e R'^ : d{x,T) > a and \x\ < 1/a}. (2.3) 

The points of F are called evolutionary singularities. 
We assume that 

(HI) g{y,x) is on M?'^ with respect to the first variable y, and Vig and Hi^ig are 
bounded and Lipschitz on M?"^. 

Remark 2.1 In most biological applications, the trait space is a compact subset X ofW^. 
However, the boundary of the trait space usually corresponds to deleterious traits. In other 
words, g{y,x) < for all y in the boundary of X. Therefore, assuming that the trait space 
is unbounded is not restrictive, since one can extend the fitness function to in such a 
way that g{y,x) < for all y ^ X and x G M'^. This amounts to add fictive traits, such 
that individuals holding these traits cannot live. 

2.2 The mutation law 

The second biological parameter, p{x, h)dh, is the law of h = y — x, where y is a mutant 
trait born from an individual with trait x. For all x S M"', we assume that this law is 
absolutely continuous with respect to Lebesgue's measure and that it is symmetrical with 
respect to for simplicity. This is a very frequent assumption in adaptive dynamics models 
(see e.g. [ISl [12 [25]). 
We also assume that 
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(H2) p{x, h)dh has finite and bounded third-order moment, and there exists a measurable 
function m : M+ — > M_|_ such that 

/ {\\h\? V \\h\\^)m{\\h\\)dh < +00, or equivalently / (r'^+^ V r'^^'^)m{r)dr < +00, 
J Jr+ 

where || • || is the standard Euchdean norm in W^, and for any x, y S M'^ and h S M'^, 
1^(3;, /i) — p(y, < llx — y||7Ti(||/i||) and p{x , h) < in{\\h\\) . (2.4) 

We will denote by (H) the two assumptions (HI) and (H2). 

Assumption (12.4(1 is satisfied for classical jump measures taken in applications. For 
example, it holds when p{x, h)dh is Gaussian for all x E M'^, with covariance matrix K{x) 
uniformly non-degenerate, bounded and Lipschitz on W^. 

Assumption (H2) trivially implies the following property. 

Lemma 2.2 Assume (H2). Let S = or S = {h : h ■ u > 0} for some u G M'^ \ {0}, and 
let f be a function from R'^ to R such that /(O) = and 

Vx,yGR^ |/(x)-/(y)| <K||x-y||max{||x||,||y||,||x||M|yf} (2.5) 

for some constant K. Then, the function 4){x) = Jg f{h)p{x, dh) is globally Lipschitz on 

Note that, in the previous statement, since /(O) = 0, \f{h)\ < K{\\h\\^ V \\hf). Thus, the 
function (p is well-defined. 

As a consequence of this result, (H2) also implies the following property, needed in the 
sequel to control the non-degeneracy of the matrix a{x): 

Va>0, inf / \h ■ u\'^\h ■ v\p{x, h)dh > 0, (2.6) 

||x||<1/q, u,vgW, \\u\\ = \\v\\=1 J^d 

where u ■ v denotes the standard Euclidean inner product between u and u G R''. Indeed, 
/iRd \h • u\'^\h ■ v\p{x, h)dh is a continuous and positive function of {x,u,v). Therefore, its 
minimum on a compact set is positive. 

Remark 2.3 Lemma \2.S\ is the only consequence of (H2) that will be used below. As- 
sumption (H2) could be replaced by any condition ensuring this result. In particular, it 
would be sufficient to assume regularity of the probability measure p{x, h)dh with respect to 
appropriate Kantorovich metrics ^31^ . See [S^ for such conditions. 

2.3 The difFusion model of adaptive dynamics 

The diffusion model of |8j is given in dimension 1. However, the computation of its pa- 
rameters can be easily generalized to a multidimensional setting (see [5] for details). The 
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parameters b = (61, . . . , 6^), b = {bi, . . . ,bd) and a = aa* = {aki)i<k,i<d, where * denotes 
the matrix transpose operator, are given by the following expressions: for all x G W^, 



bk{x) 



bk{x) 
1 



/ife[Vi5((x, x) • h]^p{x, h)dh, 

hk{h* Hi^ig{x, x)h)p{x, h)dh 



{h-Vxg{x,x)>C} 



and aki{x) 



We also define 



hkhi[h ■ Vigix, x)]+p{x, h)dh. 



b + eb. 



(2.7) 



and the matrix a appearing in p.lj) as the unique real symmetrical positive d x c? square 
root of a. 

Observe that, for all x G F, a{x) = b{x) = b{x) = 0. Thus, points of F are possible rest 
points of solutions of 

The regularity of these parameters is given in the following result. 

Proposition 2.4 Assume (H). 

(i) a and b are globally Lipschitz and bounded on M.'^, and b is bounded on and locally 

Lipschitz onW^\T. 

(ii) The matrix a is symmetrical and non-negative on X, a{x) = if x £ T, and a{x) 

is positive definite if x G \ F. For all a > 0, there exists c > such that 
Ta C {x € M'^, Vs G M'^, s*a{x)s > c||s|p}, where Fq, is defined in (EM)- 

(iii) The symmetrical square root a of a is bounded, Holder with exponent 1/2 on and 
locally Lipschitz onW^\T. 

Proof In all this proof, the constant C may change from line to line. 

Let us start with Point (i). The functions a, b and b are trivially bounded. Fix x and 
y in W^. For 1 < A; < d. 



\bkix) - bkiy)\ < 



hki[Vig{x,x) ■ - [Vigiy,y) ■ h]+)p{x,h)dh 



%[Vic/(a;, x) ■ h] + {p{x, h) - p{y, h))dh 



Since |[a]+ — \b] + \ < 1^^ ~ ^1 and Vig is Lipschitz, the first term of the right-hand side is 
less than C\\x — y\\M2, where M2 is a bound for the second-order moments of p{x, h)dh. 
Since the second term is equal to 



hk^ig{x, x) ■ h{p{x, h) - p{y, h))dh 



{h-Vtg{x,x)>0} 

Lemma [221 can be applied to bound this term by C||Vi5(x, x)|| ||x — y\ 
bounded, it follows that b is Lipschitz on W^. Similarly, a is Lipschitz on I 



Since Vi^ is 
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Take x and y in M*^ \ T and \ei S = {h e : h ■ Vig{x,x) > 0} and S' = {h : 
h • Vig(y, y) > 0}. We also denote by S'^ (resp. S"^) the complement of 5 (resp. 5') in W^. 
Then, 



2\bk{x)-h{y)\ < 



SnS' 



+ 
+ 
+ 



hk [h* {Hi^ig{x, x) - Hi^ig{y, y))h]p{y, h)dh 

hk{h*Hi^ig{x, x)h){p{x, h) - p{y, h))dh 

I hk{h*Hi^ig{x,x)h)p{y,h)dh 
Jsns"= 



(2.8) 



hk{h*Hi^ig{y, y)h)p{y, h)dh 



By Lemma [221 the first two terms of the right-hand side are both bounded by C\\x — y\ 
for some constant C. The third term can be bounded by 



C 



^m{\\h\\)dh. 



sns" 



Making an appropriate spherical coordinates change of variables, this quantity can be 
bounded by 



C0 



r'^+^m{r)dr < C'O, 



where 6 is the angle between the vectors Vig{x,x) and Vig{y,y). 

Now, fix a > 0. For all z £ Tq, Vig{z,z) / 0. Therefore, jS := inf^gr^ > 0. 

Let K be such that Vig{x,x) is JC-Lipschitz and let u = \7ig{x,x)/\\Vig{x,x)\\ and 
v = Vig{y,y)/\\Vig{y,y)\\. Then 



I II ^ Ni9{x,x) - Vig{y,y)\\ , ..^ 
\u-v\\ < — — : h||Vi5(y,y)|| 



1 



1 



\Vig{x,x) 



|Vi5(y, 



< 



K\\x — y\ 



l|Vi5'(x,a;)|| 

Now, on the one hand sin(0/2) = \\u — v\\/2 and on the other hand, sinx for 
all < X < 7r/4. Therefore, for any x,y S such that ||x — y\\ < ^/2P/K, we have 

^<^lk-?/||. 

Therefore, for any x,y S F^ such that ||x — y\\ < \/2(3/K, 



SnS" 



hk{h*Hi^ig{x, x)h)p{y, h)dh 



< Ca\\x - y\\ 



where the constant Ca depends only on a. Proceeding as before for the last term of (|2.8p . 
we obtain that b is uniformly Lipschitz on any convex compact subset of M'^ \ F, ending 
the proof of Point (i). 

Concerning Point (ii), a is obviously symmetrical, and for any s = (si, . . . , s^) G M"^, 
using the symmetry of p{x, h)dh, 



s*a{x)s 



{h ■ s)'^[h ■ Vig{x, x)]j^p{x, h)dh 
{h ■ s)'^\h ■ Vig{x, x)\p{x, h)dh. 
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This is non-negative for all s G M , and is non-zero if s / and x F. 

Fix a > 0, x € Fq,, and s = (si, . . . , s^) G M.'^. We denote by u and v the unit vectors 
of M'^ such that s = \\s\\u and Vig{x,x) = \\Vig{x,x)\\v. Then 

s*a(x)s = -||s||^||Vi(7(x, x)|| / \h ■ u\'^\h ■ v\p{x,dh) 

2 JiRd (2.9) 

>Co,\\sf\\Vigix,x)\\ 

where Cq, > by (|2.6p . Since Fq is a compact subset of M'^, we also have inf^-gr^ ||Vi5((2;, x)|| > 
0, completing the proof of Point (ii). 

Finally, Point (iii) follows from the facts that a is globally Lipschitz on M'^ and that the 
symmetric square root function on the set of symmetric positive d x d matrices is globally 
l/2-H61der, and Lipschitz in {a S 5+ : Vs S W^, s*as > c||s|p} for any c > 0. A proof of 
these facts can be found for example in □ 



3 Strong existence, pathwise uniqueness and strong Markov 
property 

Our goal in this section is to construct a particular, strong Markov solution of the SDE (II. ip . 
identify the difficulty for pathwise uniqueness and give some conditions solving this diffi- 
culty, both in the one-dimensional case and the general case. 
We fix e > until the end of this section. 



3.1 Strong existence and pathwise uniqueness: construction of a partic- 
ular solution of (11.11) 

Proposition 3.1 Assume (H). For any filtered probability space (^j)t>o,IP, W) equipped 

with a d- dimensional standard Brownian motion W , and for any x G M'^, there exists a 
J-t-adapted process X^'^ on Vt a.s. solution of fZHP with initial state x, such that X^'^ is 
constant after t, where 

T = mi{t > : X^'"" G F}. (3.1) 

Moreover, this process is the unique solution of lil.l]) up to indistinguishability satisfying 
Xl'^ = Xt'^ for all t > T a.s. 

Proof By Proposition 12.41 the functions b and a are bounded and locally Lipschitz on 
M'^ \ F. Moreover, b is bounded and globally Lipschitz on M*^. 

Assume that x ^ T and fix a > such that x S Fq. Since F^ is a compact subset of 
M*^ \ F. one can construct 6" (resp. a"') an extension to M'^ of b (resp. a) restricted to F^ 
such that 6" (resp. a"') is bounded and globally Lipschitz on (resp. bounded, globally 
Lipschitz and uniformly non-degenerate on W^). Then, strong existence and pathwise 
uniqueness for the SDE 

dXf ° = (6(1^"'") + e6°(Xf °))dt + Via"{X't''')dWt (3.2) 

with initial condition A^q ° ~ well-known results. Let 

Ta = inf{t > : X^^'" F„}. 
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By pathwise uniqueness, for any a, a' > 0, X^'"' = X^'" for all t < A r^/ a.s. Therefore, 
the process X^'^ defined by X^'^ = for i < Tq is a solution of p.ip for t < sup^^g '^a = 
r. 

On the event {r = +00}, this gives a strong solution of (II. On the event {r < 00}, 
as a solution to p.lj) . the semimartingale < r) has a uniformly Lipschitz finite 

variation part (since 6^ is bounded), and a local martingale part which is uniformly in L^, 
and thus uniformly integrable, on finite time intervals (since a is bounded). Therefore, on 
the event {r < 00}, the random variable 

X^'^ :=limX"'^ 

is a.s. well-defined and finite. Since b{x) = b{x) = a{x) = for all x £ defining 
X^'^ = Xr'^ for t > T. provides a strong solution of p.ip . 

In the case where x £ T, setting X^'^ = x for all t > trivially provides a strong 
solution of (jl.ll) . 

Now, by pathwise uniqueness for (|3.2|) . there is pathwise uniqueness for p.lj) until time 
r. Therefore, the process X^'^ we constructed above is the unique solution of (jl.ip constant 
after time r. □ 

The following result is a trivial consequence of the previous one. 

Proposition 3.2 With the same assumption and notation as in Proposition \S.ll assume 
that, for some x G \ F, 

P(X|''' r, Vt > 0) = P^(r = 00) = 1, (3.3) 

where Fx is the law of X^'^ . Then, pathwise uniqueness holds for ^-1]) with initial state x. 

The question whether pathwise uniqueness also holds for the whole trajectory when it 
can hit T in finite time is difficult. Because of the singularities of our diffusion (6 discon- 
tinuous and a degenerate and non-Lipschitz), no standard technique apply in dimension 
two or more. In the one-dimensional case, general criterions of Engelbert and Schmidt ex- 
ist on pathwise uniqueness (see [M])- However, the nature of our singularity corresponds 
precisely to a situation where the criterion does not allow to conclude. The combination 
of our singularities is also incompatible with classical results about uniqueness in law. 

Therefore, it is desirable to have conditions ensuring (I3.3|l or its converse. This is done 
is Sections 13.31 and 13. 4[ These results will also be useful in Section [H 

3.2 Strong Markov property 

The strong Markov property for solutions of SDEs is known to be linked to the uniqueness 
of solutions to the corresponding martingale problem. Here, we cannot prove uniqueness 
in general, but the strong Markov property can be easily proved. 

Proposition 3.3 Assume (H). Then the family {X^'^)x(z-^d of solutions of II 1-1]) con- 
structed in Proposition satisfy the strong Markov property. 
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Proof Let a; be a fixed point of M'^, 5 be a ^j-stopping time and tp he a bounded and 
continuous function from M"^ to M. We want to prove that 



£,X\ 



Since X^'^ is constant after time r, this is equivalent to the existence of a Lebesgue- 
measurable function / : R'^ ^ M such that 

Recall the definition of Tq, and X^'"' with initial condition x in the proof of Propo- 
sition 13.11 Since there is strong existence and pathwise uniqueness for (|3.2p , the strong 
Markov property holds for X*"'" |24l Thm. 5.4.20]. Therefore, for any a > 0, there is a 
bounded Lebesgue-measurable function fa such that 

Since X'^'^ = Xp^ for all t <Ta, this yields 

Observing that lr>5 = Ixg-'^^r is (T(X^'^)-measurable, we deduce that 

n'^^^>SV[Xl^S+t)r.J I ^S) + lr>S>rJa{X'f ) 

is (T(Xg^)-measurable for all a > 0. Letting a go to 0, it follows from Lebesgue's theo- 
rem for conditional expectations that this random variable (in short, r.v.) a.s. converges 
to E(1t->5(^(X^^_^^^^^^)|^5). As an a.s. limit of a (X^'^) -measurable r.v., this r.v. is also 
cr(X^'^) -measurable. 
Now, 

nU<sv{X'^s+t)Ar) I :Fs) =mr<s^{X'f ) I ^5) = lx-er</'(^r)> 
which is also (T(X^'^)-measurable. This ends the proof of Proposition 13.31 □ 

3.3 Study of P(r = oo): the case of dimension 1 

As we saw above, the uniqueness of X^'^ relies on the fact that "^xiT = oo) = 1, where r 
has been defined in (13.11) and where is the law of X^'^. Our goal in this section and the 
following one is to give conditions under which this is true (or false). 

In this section, we assume that d = 1. In this case, an elementary calculation gives the 
following formulas for a, h and h: 

K^) = — 2 — "^i^*-^' = — 4 — sign[di5(x, x)\di^^g{x, x), 

C'i^) = —^^-^\9ig{x,x)\, where Mfc(x) = / \h\''p{x,h)dh 

and sign(x) = — 1 if x < 0; if a; = 0; 1 if a; > 0. 

In the following result, we use the fact that dfig{x,x) + 2d1 2gix, x) + d2 2g{x,x) = 
for all X E M, which follows from differentiation of (12.111 . 
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Theorem 3.4 Assume (H). Assume also that d = 1 and g is with bounded third-order 
derivatives. Let x ^ T and define c = sup{y £ T,y < x}, c' = inf{y G r,y > x}, and 
assume that —oo < c < c' < oo, df ig{c, c) + (?f 29(^1 c) 7^ and df ig{c', c') + di 2g{c' , c') 7^ 
0. We can define 

dli9{c, c) 29^^5(c, c) 

a 



dlMc, c) + dlr,g{c, c) df ^gic, c) - dl^gic, c) 

dlMc',c') 2dl,g{c',c') ^'^ 

dl.gid, d) + dl^gid, d) dl^g{d, d) - dl^g^d , d) ' 

(a) If a > 1 and (3 < —1, then Fx{t = 00) = 1 and the process X^'^ is recurrent in {c,d). 

(b) // a > 1 and (3> -I, then Px.(t < 00) = 1 and P(limt^^ Xf"" = d) = l. 



e,x 
t 



(c) Ifa<l and 13 < -I, then Pa;(r < 00) = 1 and P(limt^^X, 

(d) If a < 1 and (3 > —1, then Px(t < 00) = 1 and 

F{limt-,r X^''' = c) = 1 - P(limj^^Xf = d) E (0, 1). 

Remarks 3.5 

• When c = —00 or d = 00, the calculation below depends on the precise behaviour of 
g and near infinity, and no simple general result can be stated. 

• The biological theory of adaptive dynamics gives a classification of evolutionary singu- 
larities in dimension d = I, depending on the values ofOf^g and 9| 29 these points. 
Here, the condition a > 1 corresponds, when d1ig{c,c) — 92 25'(c, c) > 0, to the case 
dfig{c,c) +0|25(c, c) > 0, which corresponds in the biological terminology (see e.g. 
Diekmann jj5|/ ) to a converging stable strategy with mutual invasibility, which in- 
clude the evolutionary branching condition; and when d1ig{c,c) — 9| 25(C) c) < 0, 
to the case ig{c, c) + 5|29(c, c) < 0, which corresponds biologically to a repelling 
strategy without mutual invasibility. 

Proof We will use the classical method of removal of drift of Engelbert and Schmidt and 
the explosion criterion of Feller (see e.g. [21]), which can be applied to X^'^, considered as 
a process with value in (c, c') killed when it hits c or d. These methods involve the two 
following functions, defined for a fixed 7 € (c, c'): 



i-x r n 
p{x) = / exp —2 / 



"y ¥{z)dz 



and v{x) = / p{y) / //^f^2^ -. dy, \/xe{c,c). 



7 -J-y 



dy, Vx G (c, c'), 

(3.5) 



Then [211 pp. 345-351], the statements about the limit of the process Xf when t t 
and about the recurrence of X'^ depend on whether p{x) is finite or not when j; — > c and 
c', and the statements about r depends on whether v{x) is finite or not when re — > c and 



d. 



Let us compute these limits. We will use the standard notation f{x) = o{g{x)) (resp. 
f{x) = 0{g{x)), resp. f{x) ~ g{x)) when x — > a, if f{x)/g{x) — > when x ^ a (resp. 



11 



|/(a;)| < Cg{x) for some constant C in a neighborhood of a, resp. f{x)/g{x) 
x — > a). 



1 when 



¥{x) ¥{x) M2{x) . l dl,g{x,x) 

- - sign[dig{x,x)\ + - , (3.6) 



ea'^{x) ea{x) eM3(x) ""^^ ' 2 dig{x,x) 
so, for X < y < -J, the quantity inside the exponential appearing in the definition of p is 

n dfMz, z) 



y 



j^^j-^sigii[dig{z, z)]dz + 



dig{z,z) 



-dz. 



Since c 7^ — oo, the first term is bounded for c < y < 7 (by Assumption (H), M3 is 
positive and continuous on [c, c']), so we only have to study the second term. 
When y ^ c, an easy calculation gives 



dig{z,z) z- 



+ C + o(l) 



where a is defined in (|3.4|) . and where C is a constant depending on the derivatives of g 
at (c, c) up to order 3. Consequently, when y ^ c, 



exp 



b%z)dz 



ea'^{z) 



exp 



C + 0(1) + + C + 0(1)) dz 



{y 



(3.7) 

-00. The same computation 



as y ^ c. 

Therefore, if a < 1, p{c+) > —00, and if a > 1, p(c+) 
gives the same result when x — > c', replacing a by /3. 

Now let us compute the limit of f at c and c'. Since p{c'—) = 00 ^ v{c'—) = 00 and 
p{c+) = —00 =^ v{c+) = 00 [24l p. 348], we only have to deal with the cases a < 1 and 
(3 > -1. 

Equation (|3.7|1 yields p'{y) ~ e'^(y — c)~°, so, for some constant C, 



£p'{z)a{z) 



C{z - c) 



a-l 



smce 



«(^) = — 7, — \dig[z,z)\ r — \di^g{c,c) + d^oQic, c)\[z - c) . 



-Cp'{y){y — c)" is bounded on (c, 7), and so 



If a < 0, when y ^ c, p\y) /J ^^^.^ 
;(c+) <oo. If a = 0, p'{y) /J f^pif^faiz) ~ ^ ~ '^)' which has a finite integral on (c, 7), 



so v{c+) < 00. Finally, if < a < 1, 



7 2(i^ 



y £p'(z)a{2) 



is bounded, so v{c+) < cxd is equivalent 



to the convergence of the integral p'{y)dy, which holds since p'{y) 
□ 



c 



{y-aY 



and a < 1. 
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3.4 Study of P(r = oo): the general case 

Let us turn now to the case d > 2. The following result gives conditions under which 
Fx{t = oo) = 1, based on a comparison of d{X^'^,T) with Bessel processes. 

Theorem 3.6 Assume (H). Assume also that g is on M?'^ and that the points ofT are 
isolated. For any y GT, letUy be a neighborhood of y and > and Oy > two constants 
such that a is a^-Lipschitz on Uy and s*a{x)s > ay\\s\\'^\\x — y\\ for all x ^Uy and s G W^. 
Define also 

by = inf ^ • b(x) 

x(^Uy\{y} \\x - y\\ 

and = sup -r ^ • b{x). 

xmy\{y} \\x - y\\ 

(a) If for any y£ T, h+^vll > then, for all x T, P^(t = oo) = 1 and P(limt^+oo ^ 

r) = 0. 

(b) // there exists y GT such that ^^^'^"■^ /"^ < \^ then, for all x , P(lim(^T- Xf^ = y) > 

0. 

Before proving Theorem 13.61 let us give some bounds for the constants involved in this 
Theorem. This result makes use of the notation B{x, r) for the open Euclidean ball of 
centered at x with radius r. 

Proposition 3.7 Assume (H). Assume also that g is on M?"^ and that the points ofT 
are isolated. Fix y £ T and a > such that B{y,ct) CiT = {y}. Define 



C= inf / \h ■ u\'^\h ■ v\p{x,h)dh. 

u,veR'^:\\u\\ = \\v\\ = l J 



C > by 112.6]) . Let be a bound for the third- order moment of p{x, h)dh onB{y,a). Let 
D = Hi^ig{y,y) + Hi^2giy,y), cmd denote by (resp. \y) the greatest (resp. the smallest) 
eigenvalue of D*D. Suppose also that D is invertible (\y > 0). Then, for any 6 > there 
exists a neighborhood Uy of y such that, in the statement of Theorem \3.(^ we can take 

ay = Ms^/Xy + 5, ay = Cy% - 6, 
by <^\\H,^^giy,y)\\+5 and by > -^\\H,^igiy,y)\\ - 5. 



Proof It follows from the definition (|2.7p of b that for x ^ y, 

■b{x)= [ (j-iy.h]{h*Hi^ig{x,x)h)p{x,h)dh. (3.8) 



ll^~y|| J {Vig{x,x)-h>Q} \\\^ ~ y\ 

By assumption, the quantity inside the integral can be bounded by y)|| + 

0{\\x — y\\)]p{x, h). Therefore, 

"^"^ bix)<[\\H^,^giy,y)\\+Oi\\x-y\\)] [ \\hfp{x,h)dh 



F ~ y\\ J {Vig{x,x)-h>0} 

= ^[\\H,,,g{y,y)\\+0{\\x-y\ 
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This gives the required bounds for and by. 

It follows from equation (|2.9|) in the proof of Proposition 12.41 that, for all s G M*^ and 

C\\sf\\Vig{x,x)\\ < s*a{x)s < Ms\\sf\\Vig{x,x)\\. 

Considering an orthonormal basis of in which D*D is diagonal, one has Aj;||fp < 
= y . D*Dv < A^||t;|P for any v G W^. It remains to observe that Vig{x,x) ~ 
D{x — y) when a; — > y to obtain the required bounds for and ay. □ 

Proof of Theorem 13.61 Fix y G F. Let us assume for convenience that y = 0. By 
assumption, to this point of F is associated a neighborhood Uq of and four constants 
ao > 0, a° > 0, bo and iP . Let p be small enough for B{p) := {x G M'^ : ||x|| < p] (ZUq 
and F n B{p) = {0}, and define Tp := inf{t > : || = p} and tq = mi{t > : = 0}, 
where we omitted the dependence of X^'^ with respect to the initial condition. Recall also 
the notation P^; for the law of X^ when Xq = x. 

Theorem 13.61 can be deduced from the next lemma. 

Lemrna 3.8 

(a) ifM^ > 1^ then, for all x G B{p) \ {0}, P,(r^ < tq) = 1. 

(b) If ^ < 1, then, there exists a constant c > such that, for all x G B{p/2) \ {0}, 

^x{{to < Tp} U {tq = Tp = oo and limi_,+oo Xf = 0}) > c. 

Together with the strong Markov property of Proposition 13.31 Point (a) of this lemma 
easily implies Theorem 13.61 (a), and part (b) implies Theorem 13.61 (b) if we can prove that 
for any x G M*^ \ F, Fx{Tp^2 < oo) > 0. This can be done as follows. 

Let D be any connected bounded open domain D with smooth boundary containing 
B{p/2). The process X^'" of the proof of Proposition 13.11 has smooth and uniformly non- 
degenerate coefficients. Therefore, it is standard to prove that such a process hits B{p/2) 
before hitting dD with positive probability, starting from any y £ D. (This may be proved 
for example by applying Feynman-Kac's formula to obtain the elliptic PDE solved by this 
probability in D\B{p/2), and next applying the strong maximum principle to this PDE.) 
Choosing a and D such that x £ D and D \ B{p/2) C Fq,, we easily obtain the required 
estimate. □ 

Before coming to the proof of Lemma 13.81 we need to introduce a few notation: it 
follows from Ito's formula that, for all t < t. 



1 



ll^sl 



xi-ibixD + sbixD) 



+ -TT{a{XI)) - -)-^a{X 



2 2 \\XI\\ ' \\XI\ 

where Tr is the trace operator on d x d matrices, and where, for t < t, 



ds + Mt 



Jo \\XI\\ 
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Let us extend Mt to f > r by setting Mt = Mt^r for all t > 0. Since a is bounded, Mt is 
a L^-martingale in M with quadratic variation 

iM)t=e yLa(X!)j^ds. (3.9) 







iXfll ' "\\Xf 



It follows from Dubins-Schwartz's Theorem (see e.g. [24]) that for any t > 0, Mt = -B^^^^^, 
where -B is a one-dimensional Brownian motion. 

Define the time change Tj = inf{s > : {M)s > t} for all t > 0. Ut< {M)^ := 
\imt^+oo{M)t = {M)r, then Tt < oo and (M)Tt = t. For t < (M)oo, define Yt = Xf, . An 
easy change of variable shows that for t < (M)oo, It T, and 



ll^tll = M\ + f c{Ys)ds + Bt, 
Jo 

c{z) = 



where 

..z-{b{z)+eb{z)) + eTr{a{z))/2 1 



ez*a{z)z 2||2:|| 

Using the constants defined in the statement of Theorem 13.61 the fact that b is K-Lipschitz 
on W^, and the fact that Tr(a) = Yli=i ^i'^^ii where is the i^^ vector of the canonical 
basis of M'^, one easily obtains that, for all z ^Uq, 

C,{\\Z\\)<C{Z)<C2{\\Z\\), 

where, for u > 0, 



ci(u) 



/ daQ/2 + bQ l\ 1 
I 2 J u eao 

, , / daP/2 + b^ l\ 1 2K 

and C2[u) = o " H • 

\ ao I j u eqq 

Define also the processes and strong solutions in (0, oo) to the SDEs 

fc,{Zi)ds 
Jo 



rt 

Zl = M + / CiiZl)ds + Bt 
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for i = 1,2, and stopped when they reach 0. As strong solutions, these processes can be 
constructed on the same probability space than X'^ (and Y). Finally, define for 1 < i < 2 
the stopping times 

Oo = inf{t > : = 0} 
and 9i = inf{t >0: Z' =p}. 

The proof of Lemma 13.81 relies on the following three lemmas. The first one is a 
comparison result between Z^, Z^ and Y. 



Lemma 3.9 Almost surely, Z} < \\Yt\\ for all t < 9^ A {M)oo, and \\Yt\\ < Z^ for all 
p 



t<ejA (M)c 
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The processes and are Bessel processes with additional drifts. The second lemma 
examines whether these processes hit in finite time or not. 

Lemma 3.10 

(a) Z^ is recurrent in (0, +oo) if and only if ^o+^°o/2 y ^ 

(b) Let Pu be the law of Z^ with initial state u > 0. If ^ < 1, then, for any u < p, 

Puioi < el) > 0. 

The last lemma states that, when (M)oo < oo, reaches F in finite or infinite time. 
Lemma 3.11 {(M)oo < oo} C {r < oo} U {r = cxo and limt^j^^Xf G F} a.s. 

Proof of Lemma Assume first that ^2±^a/H > and fix x G B{p) \ {0}. Then, 

by Lemma [3.101 (a), = oo and Oj, < oo a.s. Moreover, by Lemma \3M for all t < Tgi, 

ll-^fll = ll^(M>tll > ^(M),- 

Then, (M)oo = oo implies a.s. that there exists t > such that {M)t = Oj, and thus 
Tp < tq. Conversely, by Lemma [3.111 (M)oo < oo implies a.s. that limt^,- X| G L \ {0}, 
and thus that < tq. This completes the proof of Lemma [3?8] (a). 

Now, assume that < 1 and fix G B{p/2). By Lemma \3M for all t < Tg2, 

W^tW = \\y(M)t\\ < ^(M),- 

Then, on the event {9q < O^}, (M)oo = oo implies a.s. that tq < Tp. Conversely, on the 
event {9q < O^,}, by Lemma [3.111 (M)oo < oo implies a.s. that limt^T Xf = (where r 
may be finite or infinite), and thus that tq < Tp or that tq = Tp = oo and lim^^+oo X^ = 0. 
Hence, 

lPx({ro < Tp} U {ro = Tp = oo and lim Xf = 0}) > P||^||(^g < 0^). 

But, applying the Markov property to Z^, P||a;||(6'o < O^) > Pp/2(6'o < ^p) ^ ^ 

B{p/2). Since this is positive by Lemma [3. 101 (b). the proof of Lemma l3.8l (b) is completed. 

□ 

Proof of Lemma 13.91 First, remind that It is defined only for t < (M)oo. Observe that 
fort<0iA(M)oo, 



\Yt\\-Zl = [\c{Ys) - ci{Zl))ds. 
Jo 



If there exists to < Oj, A 6^ A {M)^ such that \\YtJ = Z^, then {\\Y\\ - Z'^y{to) = 
c{Yt,) - ci{Zl) = c{Yt,) - ci{\\Yt,\\) > 0, and therefore, \\Yt\\ > Z} for t > to m a 
neighborhood of to- Consequently, Z} < \\Yt\\ for any t < O^AOqA (M)oo. Since Z^ = for 
t > 9q, this inequality actually holds for t < 6p A (M)^. The proof of the other inequality 
is similar. □ 
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Proof of Lemma 13.101 The proof relies on the same functions p and v as in the proof 
of Theorem 13.41 They are given by (|3.5p . where has to be replaced by q, and ea by 1. 
For the process Z^, if we fix 7 > 0, then, for any j; > 0, 



piy) 



ry 




n 




/ exp 


—2 / ci{z)dz 


du = — exp 


2k 1 


h 






J u 



dz 



A;'(7 — u) 



du 



-C / u-^^e^'^'du, 



where we have used the constants k = _ 1 ^/ _ Consequently, p{0+) = 

—00 if and only if 2A; > 1, and p(+oo) = +00, which yields (a). A similar computation for 
gives that p{0+) > — cxd if and only if ^ +'^° < which yields Lemma fS. 101 (b). □ 



Proof of LemmalSin] Assume that P({(M)oo < 00} n {limt_^+oo G r}'^) > 0. Then, 
there exists a > such that 



5 := P((M)oo < 00, limsupd(Xf,r) > a) > 0. 

4— »+oo 

Define for any t > the stopping time Ta,t = inf{s > t : d{X^,T) > a}. Then , for any 
t > 0, 

P((M)oo < 00, r„,f <oo)>5. (3.10) 

We will obtain a contradiction from this statement thanks to the following inequality: for 
any e < 1, h £ (0,1) and any stopping time 5 a.s. finite. 



E 



sup 



0<u<h 



where C is a bound for b, b and a on M*^. This is a straightforward consequence of the 
inequality 



\Xs+u ~ XsW"^ < 2 



\\biXI) + eb{XI)\\ds] +2^e 



and of Doob's inequality. 

Taking h = 80^ /mC"^ and S = Ta,t A T, we get 



a{Xl)dWs 



sup ll-'^rctAT+u - -^T<,,tArl 

Q<u<h 



a\ 5 



Letting T +00, 



Ta^t < 00, sup ||X^ 
0<u<h 



v£ \\ ^ I < _ 



Together with inequality (jS.lOj) . this yields the first line of the following inequality, and 
the last line makes use of (13.9(1 and a constant C > such that s*a{x)s > C||s|p for any 
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s gW'- and x £ Ta/2- 

I < P ((M)oo < oo, sup X^^J|<|) 

\ 0<u<h 
<p((M)»<=o. „mf J|X;„,J| > I) 



< 



((M)oo < oo, (Af),„,+„ - (M),„_, > eC/i) . 



Therefore, 



P((M)oo < oo, (M)oo - mt > eCh) > - 



holds for any t > 0, which is impossible. □ 

4 Large deviations for as e ^ 

Our large deviation result will be obtained by a transfer technique to carry the LDP from 
the family {\/£W}e>o, where is a standard d- dimensional Brownian motion (Schilder's 
Theorem, e.g. pi p. 185]) to the family {X^}s>o, where is the solution to the SDE (frTD 
defined in section ISTTl The method of the proof, adapted from Azencott [2], consists in 
constructing a function S mapping (in some sense) the paths of ^/eW to the paths of . 

4.1 Statement of the result 

We denote by C{[0,T],R'^) (resp. C'"'{[O.T],R'^) ) the set of continuous (resp. absolutely 
continuous) functions from [0,T] to M.'^. Fix T > and x G W^, and define 



G C [[0, T], M^j , = inf{t G [0, T] : V(i) G F} A T 
and C^''{[0,T],R'^) = {^j £ C"'^([0,r],R'^) constant on [t^,T] such that -0(0) = x}. 

Then, we define for ip G C([0,r],M'^) 







2 

if VGcr([o,r],: 

+00 otherwise. 



(4.1) 



By Proposition 12.41 (ii). the inverse matrix a~^{x) of a{x) is well-defined, symmetric and 
non-negative for all a; F, so lT,xi'^) is well-defined and belongs to 1R+ U {-|-oo}. When 
= T, Ix^xii^) takes the classical form of rate functions for diffusion processes. 
This original form of rate function will appear naturally in the proof. However, as 
shown in Proposition 14.51 below, this function is not lower semicontinuous. Therefore, it is 
natural to introduce for all -0 £ C([0,T],] 



/t,xW =liminf It,. (V-), (4.2) 
which is the biggest lower semicontinuous function on C{[0,T],W^) smaller than It,x- 
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Theorem 4.1 Assume (H). Assume also that the points of T are isolated in W^. Fix 
T >0. Then, for any x GW^ and any open subset O of C{[0,T],R'^), 

liminf elnP(X^'^ G O) > - inf ItxW, (4.3) 

and for any x F and any closed subset C o/C([0,T],R'^), 

limsup elnP(X^'?^ G C) < - inf /txW- (4-4) 

The general form of the lower and upper bounds (|4.3p and (14.41) (where the limit is 
taken over y ^ x) will be useful in Section [51 This general form requires the restriction 
that x r for the upper bound for technical reasons. However, this result implies that the 
following standard form of LDP holds without any restriction. 

Corollary 4.2 Assume the conditions of Theorem \4-l\ Then, for any x G W^, for any 
open O C C([0,T],M^), and for any closed C C C([0, T], M"^), 

liminf e In P(X^''^ G O) > - inf ItxW, (4.5) 

limsupelnP(X^''' G C) < - inf ItxW- (4.6) 

Proof The lower bound (|4.5|1 is a trivial consequence of (|4.3|) and the upper bound ()4.6I) 
for X r also trivially follows from (|4.4p . If x G F, let us denote by x the constant function 
of C([0,r],R'^) equal to x. In this case, X^^'^ = x for all t > 0. Therefore, P(X^'^ G C) 
equals 1 if the function x belongs to C, and equals otherwise. Since It.x{x) < It,x{x) = 0, 
the upper bound (|4.6|) is clear when x G P. □ 



Remark 4.3 As usual for large deviation principles, Corollary \4-S\ implies the convergence 
in probability of X^'^ to the solution with initial state x of the deterministic ODE 

<P = &(</,) 

as e — > 0. This ODE is known as the canonical equation of adaptive dynamics fIR Q, U^- 

In Section [5l we will use the following classical consequence of Theorem 14.61 which can 
be proved exactly as Corollary 5.6.15 of [T2] : 



Corollary 4.4 Assume the conditions of Theorem \4-l\ Then, for any compact set K CW^ 
and for any open O C C([0, T],] 



liminf e In inf ¥(X''y G O) > - sup inf hyW, 



andifKnr = 0, for any closed C C C([0,r],M'^) 



limsupelnsupP(X^'^ G C) < - inf /t.j/(V'). 

£^0 y&K y^K, vec 
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We end this subsection with some remarks on the rate functions we obtain and their 
Hnks with the classical form of rate functions for diffusion processes with small noise. 



Proposition 4.5 Assume the conditions of Theorem \4-l\ Assume also that there exists 
an isolated point y of T such that g is at {y,y), and that Hi^ig{y,y) + Hi^2g{y-,y) is 
invertible. Then, for any x ^ T and T > 0, It^x is not lower semicontinuous. 

We postpone the proof of this result at the end of this subsection. 

General large deviation estimates are known for diffusions in with small noise using 



different techniques. For example, Dupuis, Ellis and Weiss [19] have obtained upper bounds 
under very general assumptions. We could have applied their result in our case (with some 
modifications since they consider a drift that does not depend on e, see Remark 1.2 in [19] ) 
to obtain a large deviations upper bound with lower semicontinuous rate function 



^m<trm) - bm))rci-\m)[m - hmwt 

if G C'"'{[{),T],W^) and ip{<d) = x 



+00 otherwise, 



for all V eC([0,r],M'^). 

Since obviously It,x ^ It,x and It,x is lower semicontinuous, we have It,x ^ It,x- 
Since It,x < It,x, this immediately implies that It,x and It^x coincide on C([0, T],R'^ \ T). 
Unfortunately, because of the degeneracy of a on F, we are not able to obtain an explicit 
expression for It,x{'4^) when 'i/'i £ T for some t £ [OjT"]. However, it is possible to find 
simple examples where these two rate function are not equal: Assume that d = 1 and 
is an isolated point of F, and consider a function ijj such that ■0(0) < 0, ?/'(r) > and 
It,x{'4') < +00 (such a function can be easily obtained by adapting the construction of the 
function ^ in the proof of Proposition 14.51 below). Obviously, lT,xi'4') = +00, giving the 
required counter-example. 

Therefore, our upper bound is more precise than the one obtained by classical general 
methods. This also explains why we have to use a method based on a precise study of the 
paths of X^'^ to obtain our result. 

Proof of Proposition 14.5) Take y as in Proposition 14.51 By translation, we can suppose 
that y = 0. Then, Proposition 13.71 implies that there exists a neighborhood A/q of and 
a constant oq > such that for all s S M"^ and x S A/q, s*a{x)s > ao||x|| ||sp, i.e. each 
eigenvalue of a{x) is greater than ao||x||. Therefore, for all s and x E A/q, 

s*a-\x)s < ^i^. (4.7) 
ao\\x\\ 

Take xq S K*^ \ F such that the segment (0, xq] is included in {M.'^ \ F) U A/q, and define 

for < t < r 

2t^ ^ 



m = ( 1 - ^ ) xo, 
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and for all n > 1 



m 



T 
2 



if 

otherwise 





T 1' 




"T 




t e 




U 


2 + 


-•A 










n 



Since ip{T/2 — 1/n) = ^p(T/2 + 1/n), ipn is continuous and piecewise differentiable. Note 
that i/j^t) and tpn{t) belong to [0,a;o] for all t E [0, T], that ip{t) F except if t = T/2, and 
that V'n(^) r for any f G [0, T]. Therefore, /r,xo(V') = c«, and lT,xo{i^n) < oo. 
It follows from (|4.7|) and from the fact that b is ii'-Lipschitz that 

\\{l-2t/T )2xo/T + b{mW 

lo 



< 



< 



1 
2ao 
1 



2ao 



T 



T 



2(l-2t/r)24||xo||Vr^ + 2i^^ 



(4.8) 



2^2 



Ixoll +2K^ 



(it < oo. 



Now, for all n > 1, 



2ao 



T/2+l/n 

T/2-l/n 
T/2+l/n 

T/2-l/n 



\\b{Mm' 



dt 



which is uniformly bounded in n. Hence limsup/T,xo('0n) < +oo = It^xqH^)- 

Let us extend this result to an arbitrary x F. Since the points of T are isolated in 
M"^, there exists a > and (p £ C^{[0,T],ra) such that i;^(0) = x and 0(T) = xq. Since a is 
uniformly non-degenerate on Fq, It,x{4') < oo. Therefore, it suffices to concatenate (p and 
^p to obtain a function ip defined on [0, 2T] such that limsup/2T,x(V') < hT,x{ip)- Since 
this can be done for all T > 0, this ends the proof of Proposition 14.51 □ 



4.2 Proof of Theorem l4A\ 

We first give some notation used throughout the proof. 

• Cx{I, E){resp. C^'^{I,E), C^{I,E)) is the set of continuous functions from I C 



to 

E CM.'^ (resp. absolutely continuous, resp. C^) with value x at 0, endowed with the 
L°° norm. 



For if £ C{[0,T], 



and 



and < a < b < T, define 

\\^\\a,b = sup 
a<t<b 



(4.9) 



When a = and 6 = T, II • ||o,t is the usual L°° norm in C{[0,T],R'^) 
the usual closed ball centered at if with radius 5 for this norm, also simply denoted 



(4.10) 

and Bt{(P, 6) is 
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We are actually going to prove the following result. 

Theorem 4.6 Assume the conditions of Theorem \4-l\ Then, for any x £ and any 
open subset O of C{[0,T], 



liminf elnP(X^'^ G O) > - inf /t.zW, (4-11) 

and for any x and any closed subset C of C{[0,T],W^) such that Cj.([0, T], M*^ \ F) is 
dense in C n Ca:([0, T], M*^), 

limsup elnP(X^'^ G C) < - inf It,xW. (4.12) 

This is an incomplete LDP involving the non-lower semicontinuous rate function It,x- 
From this can be deduced the LDP involving the rate function It,x (Theorem 14. ip as 
follows. 

First, by definition of It,x, for any open O C C([0, T], M*^), 

inf It,x{'4') = inf lT,x{tp)- 

Therefore, (14. 3p is immediate. 

Moreover, It,x < It,x, so (|4.4I1 obviously holds for the same closed sets as in Theo- 
rem Now, let K be any compact subset of C([0, T], M*^). Since It,x is lower semicon- 
tinuous, for any r/ > 0, there exists a > such that 

inf It,x(^) < inf iT,xW+V, 

where 

Ka= U B{ip,a). 

Indeed, if this would fail, there would exist t] > and two sequences {'ipn)n>i and {ipn)n>i 
such that ipn G Wipn — ipn\\o,T < l/'T- and lT,x{ipn) < lT,x{ipn) — V for all n > 1. Since K 
is compact, we could then extract a subsequence {'4'i„) of (V'n) converging to some ip £ K. 
Since It,x is lower semicontinuous, this would imply that 

It,x{i(j) < liminf /T,x(V'j, J < inf lT,x{tp) - Vi 

which is a contradiction. 

Now, let ■01 , . . . , ■i/'n be such that 



K^ = \jB{iJi,a)D K. 



i=l 



Since Kn C Ka 



inf It,x(V') < inf iT,xiip)+'n- 



Moreover, the points of F are isolated, and thus any point of the interior of Ka is obviously 
limit of elements of Ka H C^([0, T],]R'^ \ F). Since Ka is the closure of its interior, any 
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point of dKa is also limit of elements of n C^([0,r],]R'^ \ T) by a diagonal procedure. 
Moreover, Ka is closed. Therefore, one can apply (|4.12|) to this set: 

limsup elnP(X^'?' e K) < limsup elnP(X^'^ G ^a) < - inf /t,x#) 

£— >0, y^x e^O, J/— >a: ip^Ka 

< - inf It,xW < - inf hA'^) +V- 

Since this holds for all > 0, (14. 4|) is proved for compact sets. 

The extension to any closed sets is classically deduced from the following uniform 
exponential tightness estimate. 

Lemma 4.7 For any k > and y € M.'^, define the compact set 

Kl = e Cy{[0,T],R'') -.yi > k, u;(^ij,^^ < y| , (4.13) 

where uj{il),5) = sup|j_s|<5 — Then, there exists k^ and Eq, such that for all 

y G M'^, k > ko and e < eo, 

5lnF(X^.^0i^f)<-^, (4.14) 

where S := sup^jgi^d ||(t(x)||. 

Then, taking any closed C G C([0, T],M'^) and choosing k large enough, 

lim sup e In P(X^'?' G C) < sup | lim sup e In P(X^'^ G C n K^) , 

limsup elnF{X^'y ^ K^) 

e^O,y^x 

< - inf ItM, (4.15) 

ending the proof of Theorem 14.11 □ 

The proof of Lemma [4771 makes use of the following classical exponential inequality for 
stochastic integrals, of which the proof is omitted. This result will be also used in the proof 
of Theorem 14.61 below. Let M.d,d denote the set of real d x d matrices. 

Lemma 4.8 Let Yt be a J-t-martingale with values in on a filtered probability space 
{Q,J^,Tt,^), and suppose that its quadratic covariation process {Y)t satisfies supf^rp \\{Y)t\\ < 
A. Let T be a J-t stopping time, and let Z : M_|_ x ^ Md,d be a progressively measurable 
process such that supj<^ W^tW < B. Then for any R > 0, 





i-tAr 




sup 


/ ZsdYs 


>r\< 2dexp 


\t<T 


Jo 





2dTAB'^ 
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Proof of Lemma [4771 It follows from ([TTT]) that, for any y G M'^, s > and t £ [0,T], 
Fix h > and R> Ch. Applying Lemma [481 we have 

{R - Chf 



sup - Xl'^W >R \ < 2dexp 



n<s<h 



2dheT? 



Writing this for t = ih for < i < T / h, we deduce that 

r(MX', k) > 2K, < 2d (I + l) e.p {-^-^^) . (4.16) 

For any I > 1, set Ri = 1/21 and hi = 1//'^. Then, for sufficiently large Z, Ri > Chi and 

{Ri - Chi)' _ {Vl- 2C/l'/y ^ {Vl/2f _ I 
2deS2/ii 8deS2 - 8de^' 32deS2 ' ^ ' ' 

Observing that 

Ky = {i>eCy{[0,T],X):yi > k,Lo{i;,hi) < 2Ri}, 
inequality KT^ easily follows from ([iTTGl) and KT7\ . □ 

4.3 Proof of Theorem SH 

The proof of Theorem 14.61 makes use of the function It,x and of the (good) rate function 
of Schilder's theorem (LDP for Brownian motion) 




'dt if (/7 E Q'^([0,r], 
otherwise. 



First, we need to construct the function S "mapping" Brownian paths to the paths of 
X'. For any ip G q^([0,r],R'^), let S{ip) be the solution on [0,r] to 

S{ip){t)=x + [\{S{ip){s))ds + f a{S{^){s)Ms)ds, (4.18) 
Jo Jo 

obtained as follows: by Proposition 12.41 (i) and (iii), b and a are bounded and locally 
Lipschitz on \ F. Therefore, Cauchy-Lipschitz's theorem implies local existence and 
uniqueness in M*^ \ F of a solution to y = b{y) + a{y)ip. This defines properly S{ip) until 
the time where it reaches F. In the case where ts[ip) < T, set S{ip){t) = S{(p){tsi^ip)) 
for ^^(y,) < t < T. The function S{ip) obtained this way is a solution to (14.181) on [0, T] 
and belongs to C^^{[0,T],R'^). 

The proof of Theorem 14.61 is based on the following two lemmas. The first one gives a 
precise sense to the fact that the function 5 maps the paths of \/eW to the paths of X^'^. 
The second one gives the relation between S, It,x and Jt- Their proof is postponed after 
the proof of the theorem. 
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Lemma 4.9 

(i) Fix if G Cg'^([0, T], R'^) such that tp := S{ip) takes no vahie in T and such that Jt{^) < 

+00. Then, for all rj > and R > 0, there exists 6 > such that 

limsup elnP {WX^'^ - S(v?)||o,t > i], WV^W - ^||o,t < S) < -R. (4.19) 

(ii) Fix (p G Q'=([0,T],M'^) such that ipit) := S{'f){t) e T for some t e [0,r]. Define 

ip{t) = (p{t) for t < and ip{t) = (p{t^) for < t < T. Then S{ip) = S{ip) = xp. 
Suppose that Jri^) < +00. Then, for all r] > and R > 0, there exists 5 > such 
that ifiJP|) holds. 

(iii) With the same ip as in (i), for all 6 > and R > 0, there exists r/ > such that 

limsup elnP - S{ip)\\o,T < ??, \\V^W - ^||o,r > S) < -R. (4.20) 

Lemma 4.10 

(i) ForalltPeC^{[0,T],R'^), 

lT,xitp) = inf{ Jt((^), S{ip) = ip} 

and when It,x{'P) < +00, there is a unique ip G Cq'^{[0,T],W^) that realizes this 
infimum, and this function is constant after t^. 

(ii) C^{[Q,T],W^ \ T) is dense in S{{Jt < 00}). 

In OdH], and a are assumed Lipschitz, and thus Point (i) of Lemma l4.9l can be proved 
for all ip G Cq'^([0, T], R'^), which is enough to conclude. In our case, because of the bad regu- 
larity of the coefficients of the SDE, we cannot prove (i) for all ip € Cq'^([0, T], R'^). As a con- 
sequence, we are only able to obtain the large deviations lower bound from Lemma 14.91 (i) 
and (ii). In order to prove the large deviations upper bound, we use an original method 
based on Lemma US] (iii). 

Lemma [4.101 is an extension to our case of very similar lemmas in [2l [T6]. 

Proof of Theorem 14. 6t lower bound It is well-known that the lower bound (|4.1ip 
for any open set O is equivalent to the fact that, for all ■0 S Cx{[0,T],M.'^) and r] > 0, 

liminf elnF{\\X^'y - V'Hcr < ??) > -It,x{'>P)- (4.21) 

£^0,y^x ' ' 

Fix Ip and rj as above, and assume that It,x(V') < +00 (otherwise, there is nothing to 
prove). By Lemma [4.101 (i). there is a unique ip G Cg'^([0, T], R'^) such that S{ip) = ip and 
u := Jt{^) = It,x{'P)- Choose R > u. If the image of ip has empty intersection with F, 
apply Lemma [49] (i). Otherwise, apply Lemma [49] (ii). In both cases, there exists 5 > 
such that 

limsup elnP {\\X^'y - iP\\o^t > r], - ip\\o,T < S) < -R. 

Since 

P(|| - ip\\o,T <6)< F{\\X''y - Vllo.T < v) 

+ ¥{\\x''y - ip\\o,T > V, WV^w - ^\\o,T < s), 



25 



we deduce from Schilder's theorem that 



< limmi elnF{\\^/eW - ifWo^T < 

< sup I Uminf elnP(||X"'?' - V||o,T < v), 



hminf elnP(||X^'^ - ^||o,t > V, WV^W - ^\\o,t < S)] 



< sup<^ hminf eln¥{\\X''y - tp\\o,T < v),-R 

and since R > u, (|4.2ip is estabhshed. □ 

Proof of Theorem 14. 6t upper bound We first prove (|4.12p for particular compact 
sets: let K be a non-empty compact set of C([0, T], M*^) such that S{{Jt < +00}) is dense in 
K^, where K^; := K nC^{[0,T],R'^). By Lemma |130] (i), S{{Jt < +00}) = {It,x < +00}, 
and so u := mf{lT,x{'ip),'4' S K} < +00. 

Fix p > 0. For any ip £ K H S{{Jt < +00}), by Lemma r4. 101 (i), there exists a unique 
ip G Cq''{[0,T],R''-) constant after such that S{ip) = ip and lT,x{i') = '^t(v') < 00. We 
intend to use Lemma US] (iii), which holds only if il) takes no value in F. So we have to 
introduce > such that 

1 Z"*"^ II ■ 112^ P 

- / 1199^11 ds < -, 

SO that Jri^) < Jt^-a^{'^)+ p/'^- Since Jt^-a^ is lower semicontinuous, there exists 6^ > 
such that 



e Bt^,^c,^{ip,6^), Jt^-a^{ip) > Jt^-a^{<f) - I > Jriif) - p, (4.22) 



where Bt{ip,6) has been defined in (|4.10|) . 

Applying Lemma [13] (ii) to ^p with T = t^ — a^, 6 = 5^ and R > u, there exists 77^ > 
such that 

limsup elnP {\\X'^y - ^||o,t^-a^ < V^, \\V^W - ip\\o,t^-a^ > S^) < -R. (4.23) 

e^O,y^x 

Since we have assumed that n S{{Jt < +00}) is dense in Kx, 

KxC IJ BT{i),il^). 

^l)l^K:,r\S{{JT<+oo}) 

Since is compact, there exists a finite number of functions -^i , . . . , V'n in Kx H S{{Jt < 
+00}) such that 

n 

Kx C \jBTiiJi,Vi), 
1=1 



26 



where we wrote rji instead of r/^^. Since K is compact, there exists a neighborhood Mx of 
X such that 

n 
i=l 

where Kj^^ = {-0 G : ■i/'(0) G A^}. 
Now, define 

n 
i=l 

where ti = t^^, Oj = and 8i = (5^., and where ipi is the function satisfying S{ipi) = V'i 
and lT,x{ipi) = Jrifi)- Then, for any y G AAs, 

P(X='^ eK)< F{^/IW G [/) + P(V^Ty U, X^'y G X'atJ 

n 
i=l 

n 

+ - ^illo,T < Vi, V~eW U) 

i=l 

n 

<Y,n\\VeW-^ih,u^o..<6i) 

i=l 

n 
i=l 

Since by Schilder's Theorem and (|4.22|) 

limsup elnF{\\y/eW - ipi\\o,u-a, < Si) < - inf Jt^^a.i^) < -Jri^i) + P, 

we finally deduce from (|4.23l) that 

limsup elnP(X^'^ G K) < supi sup (- Jt(v?») + p), i 

£^0,y^x l,l<i<n J 

< sup {- inf{/T,x(^), V' ^K}+ p, -R} <-u + p. 
Since this holds for any p > 0, the proof of (|4.12p for the set K is completed. 

Now, let C be a closed subset of C([0,r],M'*) such that C^([0,T],M'^ \ T) is dense in 
CnC^([0,r],M'^). Define the compact set 

Kk = {^J G C([0,T],M'^) : ||V(0) - x|| < 1,V/ > /c, cj(V', < l/k] 

= U 

\\y—x\\<l 

where is defined in (|4.13p . In order to apply the previous upper bound for compact 
sets, we are going to construct a compact set D such that S{{Jt < oo}) is dense 
in C n Kk n Cx{[0,T],M.'^). This will be enough to conclude since, by Lemma HTl 

limsup elnP(X='^ Kk) < limsup elnP(X^'^ Kk) < -k/MdT?, (4.24) 
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so that the upper bound (|4.12|) will be proved as in (|4.15p . 

The set can be constructed as follows. The set C n Kj^ nCx{[0,T],R.'^) is compact, 
so it is separable. Let {ipn)n>o be a sequence of functions dense in this set. For all n > 0, 
Tpn S C, SO, by assumption, there exists a sequence {ipn,p)p>o in C n C^([0,T],M'^ \ F) 
converging to ^pn, such that \\'4'n,p — V'nllo.T < for all p > 0. Let us define 

Kk = Kkul\J {V'n.p ■.p>n}\ , 

\n>0 J 

and let us prove that is compact. Let {(pm) be a sequence of i^T^. Extracting a converging 
subsequence is trivial, except in the case where {m : (j)m £ Kk} is finite, and when for all 
n > 0, {m : (pm £ {ipn,p ■ P > n}} is finite. In this case, there exists two increasing 
sequences of integers (am) and (/3m) such that for all m > 0, (pa^ ^ {V'/3m,p • P ^ f^m}- 
For all m > 0, ipf^^ belongs to the compact set C H H Cx{[0,T],W^), so, extracting a 
subsequence from {(3m), we can assume that V'/?™ ip & C H fl Ca;([0, T], R'^). Then 



when m ^ CO. Hence is compact. Moreover, Kk has been constructed in such a way 
that C^([0,r],R'='\F) is dense in C n n C^([0, T], M^), as required. This ends the proof 
of Theorem gjl □ 

4,4 Proof of Lemmas 14.91 and 14.101 

Proof of Lemma 14.91 Let ip be as in any point of Lemma 14.91 We will first restrict 
ourselves to the case 93 = by means of Girsanov's Theorem. Define on (fijj^r) the 
probability measure W'^ by 

d^^'^ ( ^ r ■ ,T.. 1 /"^ „ ■ „2 , 

exp — / ipsdWs-— / Ws\\ as 



dF Jo 2e 







Since in all cases Jrif) = 1/2 Jq WiptW^dt < +00, by Novikov's criterion, Girsanov's The- 
orem is applicable and implies that 

w! ■.= Wt-^ 

is a P'^'^-Brownian motion for t < T and that, P^'^-a.s., for any t <T, 

X'^'y = y + fib^Xl'y) + a{Xl'y)p,)ds + V~e f a{Xl^y)dWl. (4.25) 
Jo Jo 



Let 



pe,y ^ 111^.,?; _ S{ip)\\^^T > V, WV^W - ip\\o,T < S} 

= {\\x'^y - s{ip)\\o,T > V, WV^w^o^T < s}. 
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It follows from Cauchy-Schwartz's inequality that 



dF 



dF 
dF^ 



dF^'y 



(4.26) 



Now, 



dF^'V 



exp 



exp 



2 
Jo 

T 







X exp 



T 



dW! 



\^Ps\\ ds 



lips 



ds 



\^Ps\\ ds 







The first term in the product of the right-hand side is a P'^''^-martingale (by Novikov's 
criterion), and the second term is equal to exp(2Jr((/9)/e). Therefore, (|4.26p implies 



elnP(F"'^) < - \nF^'y{F^^y) + Jt{^). 



Therefore, Lemma [4.91 follows from the next result. 



□ 



Lemma 4.11 The three points of Lemma hold when {4-1^ o.nd ^.20\ ) are replaced 
respectively by 

limsup elnF^'y (\\X^'y - 5(<^)||o,r > V, \\V^W'\Wt <d) <-R (4.27) 

e— >0,j/— »x ^ ' 



and 



limsup elnP^'^ ( \\X^'y - S{^)\\o,t < V, \\V^W'\\o,t > S] < -R. (4.28) 



Lemma 14.111 relies on the following lemma, of which the proof is postponed after the 
proof of Lemma 14.111 

Lemma 4.12 With the previous notation, let Yt he a F^'y -martingale in such that 
^^Pt<T \\0^)t\\ ^ ift T be a stopping time, and let ^ be a uniformly continuous bounded 
function on W^. Then, for any r] > and R > 0, there exists 5 > and Eq > both 
depending on Y only through A and both independent of t, such that for any y G M'^ and 

e < So, 



elnP^'?^ 



At 



V~e / aX!''')dYs 



> 7], \\V^Y\\o,T <S] <-R. 



(4.29) 



0,T 



Proof of Lemma 14. Ill (i) The function ^p = S{if) does not take any value in F on [0, T] , 

so there exists a > such that \/t £ [0,T], ^pt G Tq- Suppose without loss of generality 
that T] < a/2, and define for y 6 M"^ 

T^'y = m{{t : d{X't'y,T) < a/2} A T. 
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When T^'y < T, \\X% - S{(p)r^,y\\ > d{S{^)r^.y ,r) - d{X%,T) > a/2 > rj, so 

\\x''y - s{^)\\o,T >v^ - s{'p)\\o,r^,y > V- 

Consequently, (|4.27|1 will be proved if we find 5 > such that 

limsup elnF''y{\\X^'y - S{ip)\\o,r-,y > r], \\VEW'\\o,t < S) < -R. 

Take C such that a and b are C-Lipschitz and b is bounded by C on Ta/2- It follows 
from (fi:25]l that, for t < t^'V, 



\xp'^-siv)t\\<V^ 



aixi'y)dw, 



+ e / \\b{Xt'y)\\ds+\\x-y\ 



+ \\b{Xl^y)-b{S{^)s)\\ds+ \\a{Xl^y)-a{S{^)M\mds 



aixi'y)dw, 



+ eCT + \\x -y\\+C [\l + ys\\)\\Xl'y - S{ip)s\\ds. 
Jo 



Since u := Jq WifsW^ds < +00, by Gronwall's lemma and the Cauchy-Schwartz's inequality, 
for t < T^'y 



\XP'-S{M<{V~e 



aixpy)dw, 







+ eC7r+ ||x-y|| exp C T + V^ 



Therefore, it suffices to find 6 > such that 



limsup elnP"^'^ \/e 

e—f0,y—fx \ 



aixpy)dw, 



>r?/3, Vi\\W\\o,T<s] <-R, 



where (3 = exp[— C(r + \/uT)]/2. This is an direct consequence of Lemma \4.V2\ with 

Y = , A = 1, ^ = a and T = r^^y. □ 

Proof of Lemma 14.111 (ii) In Lemma 14.111 (ii), ip is defined from cp hy (ft = (pt for 

t <t^, and ipt = (fit^ otherwise, where ip = S{'f) = S{ip). By Cauchy-Schwartz's inequality, 
Jq'*' \\'-Ps\\ds < (2TJj'((/?))^/^ < +00, so there exists p > small enough such that 



\'^s\\ds < 



rje 



-CT 



8C 



(4.30) 



where C is a constant bounding b, b and a, and such that b is C-Lipschitz. 
Now, we have 



where 



\x''y - ij\\o,T > V, \\V^w'\\o,T <s}c D^'y u 

\X''y -i;\\t^_p,T>ri,\\VIW'\\o,T<S 



\0,t^-p 



< 



■qe 



-CT 



and E'^y = i \\x''y 



\0,t^-p 



-CT 
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Part (i) of Lemma [4.111 shows that P^'?'(£"^'?') has the required exponential decay if 6 is 
small enough. Let us estimate P^'^(Z)^'^). 

It follows from (|4.25|) and from the fact that (/ij = for t > that, for any t > — p 



\xt'y-M<\\xt;%-^t,-p\\ + V^ 



+ c 



\Xl'y - Tp,\\ds + eCT ~ 



t,i,M 



\a{Xfy)-a{ijM]\mds. 



On the event D^'^, the first term of the right-hand side is smaller than r/e '^"^/4, and, since 
a is bounded by C, the last term is smaller than 2C jl^_p \\'P\\ds < r/e~*^"^/4 by (I4.30p . 

Moreover, we can assume e small enough to have eCT < rye~'^^/4. So, on the event Z)^'^, 
by Gronwall's Lemma, for t >t^ — p, 



-0*11 < I 7r?e-^^ + 



a{xi^y)dwi 



t^~p 



Since \\X^'y 



D^^y c 



\tii-p 



T > ^ on D^'y ^ we finally obtain 



t-ijj-p 



> 



-CT 



-, \\^{W'-Wt 



t^-p)\\h-p,T 



< 25 



t^-p,T 



Equation (I4.27|l is now a consequence of Lemma 14.121 



□ 



Proof of Lemma 14.111 (iii) As for Point (i), take a > such that S{ip)t G Pq, for all 
t e [0,T]. Fix r/ < a/2. Then, on the event - S{ip)\\o,T < ??}, for any t G [0,r], 

X^'y G Take C such that b and a are C-Lipschitz and b is bounded by C on 

It follows from that, on the event {\\X^'y - S{ip)\\o,T < for any t £ [0,T], 



aiXl'y)dW! 



< WX't'y -S{v)t\\ + \\y-x\\ + 







+ 



[b{xi'y)-b{s{^)s)]ds 

■T 



[a{Xl^y)-a{S{ip)s)]^sds 



e / b{Xl'y)ds 



<27] + C [ (1 + ys\\)\\XI - S{ip)s\\ds + eCT 

JO 

< r]{2 + 2CT + CVuT) 

if e < 7]. Therefore, 

{\\x'^y - si^)\\o,T < V, \\V^w'\\o,T > s} 



C |vtG [0,r], Xf^GPi, 
where [3 = 2 + 2CT + CV^. 



a{xi^y)dw! 



<r]p, V^\\W'\\o,T>6\ , (4.31) 



0,T 
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Let 



= inf{t : d{Xt'y,r) < a/2} A T, 

Yt'= fa{Xl^y)dWl 
Jo 



where x is a Lipschitz function from to [0, 1] such that x{x) = if d{x,r) < a/4 and 
x{x) = 1 if d{x,T) > a/2. With these notations, (|4.31|1 imphes 

{\\x'^y - 5M||o,T < V, \\V^w'\\o,T > s} 

V^\\Y'''h,T<r]/3, ^ / axt'y)dY,''y >6\. 

Jo 0,T ) 

Equation (|4.28p is now a direct consequence of Lemma l4.12t ^ is Lipschitz and bounded on 
R'^ by Proposition [23](iii), and for any t < r'^'y, {Y^'y)t = Jq a{Xl'y)ds which is bounded 
by a constant A independent of y and e, by Proposition 12.41 (i). □ 

Let us come to the proof of Lemmas 14.121 It is adapted from the proof of Lemma 1.3 
of [16], and makes use of Lemma HiHl 

Proof of Lemma 14.121 We use a discretization technique: for any p G N, we define 
Xpy,P ^ Xl'y_p, where fc G N is such that k <t2P < k + l. Given 7 > 0, p > 1 and 5 > 0, 
we can write 



where 



'8 1 '^\{xpy)dY, 
10 



> 7], WV^YWo^T <5} CA'UB'UC 



0,T 



\x''y-x''y'P\\o,r>i}, 



\x^'y - x^^y'P\\Q^r < 7, 



[ \axt'y)-({xi'y'n]dYs 

Jo 



>1 



0,T 



and 



At 



V~e / aXl^y^dY, 




>i \\V^Y\\o,T<6\. 



0,T 



We will choose 7 such that F'^'y{B^) is sufficiently small, next p > 1 to control P'^'^(j4'^), 
and finally 6 > such that C"^ = 0. 

First, we apply LemmalUwith Zt = ^'P)]. Let := sup||2._y||<^ 

^(y)||, which is finite since ^ is uniformly continuous. Then, on B^ , \\Zt\\ < y^M^ for all 
t < T. Therefore, 

P«(B') < 2<iexp {-^^) . 

Now, — > when 7^0 since ^ is absolutely continuous. Therefore, choosing 7 small 
enough, elnP='?^(5^) < -2R for all e < 1. 
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Second, 7 > being fixed as above, (|4.25|) yields 



^^y{\\x''y -x''y^p\\Q^r>i) 

T2P-1 / 



k=Q 
T2P-1 



sup 

, A:2-P<t<{A:+l)2-P 



fc=0 
T2P-1 

fc=0 
T2P-1 



sup 

fc2-P<t<(A;+l)2-P 



tAr 

k2-PAT 
tAr 



>1 



sup 

k2~P<t<{k+l)2-P 



k2~PA- 
tAr 

^ 

k2-PAT 



[b^{xi'y) + aixi'y)^,]ds 

^a{Xl'y)dW, 



> 



7 



>1 



k=0 



+ F^'MC72-P + C2-P/2^> 



where C is a bound for and a and u = WcpsW^ds < +00. For p big enough, the second 
sum of the right-hand side equals 0. For the first sum. Lemma 14.81 with t = T = 2~^, 
Y = 1^, A = l, R = -ill and B = y/eC gives that 



sup 

fc2-P<t<(fc+l)2-P 



tAr 



k2-PAT 



recy{Xfy)dWl 



> ^ < 2dexp 



7V4 



2d2-PC^e 



for all < A; < T2P. Therefore, taking p large enough, elnP='?^(^=) < -2R for all e < 1. 
Third, with p > 1 and 7 > as above, for t <T, 



l-tAr T2P-1 



i+l)2-PAtAT ^2-PAtAr 



Therefore, since ||-v/ey||ro ti < S on the event C^, we have for alH < T 



.tAr T2P-1 



where C is a bound for ^. Hence = as soon as <5 < 7?2-(p+2)/CT. 

We finally obtain that elnP^'2^(A^ U U C=) < eln2 - 2R, which yields K29\i for e 
small enough. 

This argument is true for any y G M"^ and for any stopping time r. It remains to observe 
that A is the only information about Y that we used to estimate P^'^(i3^), that Y does 
not appear in , and that no assumption about Y is necessary to obtain = 0. Hence, 
the constant A is the only information about Y required to obtain S and Eq. □ 

The proof of Lemma 14.91 is now completed. It only remains to prove Lemmas 14.101 

Proof of Lemma Sm Let us first prove Point (i). Take tp £ C^'=([0, T], M'^). Any 
if G C^%[0,T],W^) such that S{ip) = V' must satisfy for any t G [0,t^) 
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Therefore, such a ip is uniquely defined for t < hy 

ipt = a'\i;t)bPt - b{i;t)]. (4.32) 
Thus ^ ^ 

for any ip such that S{ip) = i/j, and It^iI^) = Jrif) if and only if c^j = for all t > t^. 

This trivially implies that It,x{'4') = iiif{ Jt(v'), S{ip) = ip} when Ix^xitp) = +oo. In the 
case where It,x{iP) < +oo, we clearly have It,x{iP) < i^^i-Jxi^), S{ip) = Tp}. To prove the 
converse inequality, it suffices to check that there exists an absolutely continuous function 
If satisfying (I4.32p for t < and (ft = lov t > t^. This is equivalent to the fact that 

{■4't)bPt — b{ipt)] is on [0, t^]. Since /r,x(V') < +oo, this function is actually L^, which 
ends the proof of Point (i). 

For Point (ii), remind that a is uniformly non-degenerate on Pq, for any a > 0. 
Therefore, the fact that C^{[0,T],R'^ \ T) C S{{Jt < oo}) follows from Km . Since 
S{{Jt < oo}) C C^'=([0,r],M'^) and any function of CS^([0, T], R"^) is the limit of elements 
of Ci([0,r],M'^ \r). Point (ii) is clear. □ 



5 Application to the problem of exit from a domain 

We study in this section the biological phenomenon of punctualism. We consider a bounded 
open subset G of M'' containing a unique, stable equilibrium of the canonical equation of 
adaptive dynamics cp = b{(p). We will assume for convenience that this equilibrium is 0. 
Note that the equilibria of the canonical equation are exactly the points of P. As observed 
in Remark [4. 3 1 when e is small, X^'^ is close to the solution of this ODE with initial state x 
with high probability. Yet, the diffusion phenomenon may almost surely drive X^'^ out of 
G. Our next result gives estimates of the time and position of exit of X^ from G ("problem 
of exit from a domain" |21|). 

We will follow closely section 5.7 of Dembo and Zeitouni [12j, where a similar result for 
non-degenerate diffusions is proved. 

When the initial condition of the solution of the SDE constructed in Proposi- 

tion [3]T] is not precised, it will by denoted by X^. The value of X^ at time will then 
be specified by considering the probability of events involving X^ under F^, which is 
the law of the process X^''^. Expectations with respect to will be denoted E^;. We 
will also use throughout this section the notation B{p) := {y G M"^ : ||y|| < p} and 
S{p) = {y G R'^ : ||y|| = p} for p > 0. It will always be implicitly assumed that /> > is 
small enough to have B{p) C G and S{p) C G. 

We will assume d > 2. Otherwise, the problem has few interest: if G = (c, c') C M 
contains a unique point x of P, and if y > x (say), the process X^'^ can exit G, only at 
c', and the probability of reaching x before c' can be computed explicitly using classical 
results on one-dimensional diffusion processes Prop. 5.5.22]. 



Let 



Viy,z,t)= inf It,yW^ 

{VeC([0,t],Rd):^(0)=j;,^(t)=z} 
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which is, heuristically, the cost of forcing X^'^ to be at z at time t. Define also 

y(y,z) =inf V{y,z,t). 

The function 1^(0,2:) is called the quasi-potential |21| . 
Six assumptions are required for our result: 

(Ha) G is a bounded open subset of M'^ such that GnT = {0} and with sufficiently smooth 
boundary dG for 

= inf{t > : G dG} 
to be a well-defined stopping time. Moreover, for any solution of 

4> = h{(p) (5.1) 
such that (/)(0) G G, we have (/)(t) G G for alH > and limt^ao (f'i't) = 0- 
(Hb) V ■.= m(,^9GV{0,z) < oo. 

(He) For any e > and y G G \ {0}, Fy ( lim = o) = 0. 
(Hd) The points of V are isolated in R"^. 

(He) For any y G G n F, g is at (y, y) and Hi^ig{y, y) + -f/'i,2y(y, y) is invertible. 

(Hf ) All the trajectories of the deterministic system (15. 1|) with initial value in 9G converges 
to as t — > oo. 

Assumption (Ha) states that the domain G is an attracting domain for (|5.ip . If As- 
sumption (Hb) fails, all points of dG are equally unlikely on the large deviations scale. 
We have given in Theorem 13.61 (sections 13.41) conditions under which (He) holds. Assump- 
tion (Hd) is required in the large deviation Theorem 14.11 We have already encountered 
an assumption similar to (He) in Propositions 13.71 and 14.51 It allows to control the non- 
degeneracy of a{x) near G n F. Finally, Assumption (Hf) prevents situations where dG 
is the characteristic boundary of the domain of attraction of 0. This last assumption is 
needed only for Point (b) of the following result. Note that when (Hf) is true, GnF = {0} 

Theorem 5.1 

(a) Assume (H) and (Ha-e). Then, for all x e G \ {0} and 6 > 0, 

limP^(r" > e^^-"^)/^) = 1. (5.2) 

(b) Assume (H) and (Ha-f). If N is a closed subset of dG and if inf^g^f ^(0, z) > V, then 

for any x £ G \ {0}, 

limP^(X^. G iV) = 0. (5.3) 

e— >0 

In particular, if there exists z* G dG such that V{0, z*) < V{0, z) for all z G dG\{z*}, 
then, for any 6 > and x £ G \ {0}, 

limP^.(||X^. < 5) = 1. (5.4) 

£— >0 
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The proof of such results is classically guided by the heuristics that, as e — > 0, 
wanders around for an exponentially long time, during which its chance of hitting a 
closed set N C dG is determined by inf^g^r y(0, z). Any excursion off the stable point 
has an overwhelmingly high probability of being pulled back near 0, and it is not the time 
spent near any part of dG that matters but the a priori chance for a direct, fast exit due 
to a rare segment in the Brownian motion's path. 

Usually, such results also include an upper bound for r^. We are not able to obtain 
such a result because of the singularity of the process at 0. Because the matrix a{x) 
is at X = 0, the time spent by the process near before hitting S{p) is not uniformly 
bounded (in probability) with respect to the initial condition (actually, it is even infinite 
when = 0). 

For this reason, the proof of a similar result in Dembo and Zeitouni |12j (Thm. 5.7.11 
and Cor. 5.7.16) cannot be directly adapted to our situation. Below, we are only going to 
detail the steps that must be modified. In particular. Theorem 15.11 (a) will be obtained 
exactly as in [12], whereas Point (b) has to be obtained without using any upper bound 
on T^. 

We are going to use four lemmas. The first one gives estimates on continuity of V{x, •, t) 
around and dG. 

Lemma 5.2 Assume (H), (Hd) and (He). For any 5 > there exists p > small enough 
such that 

sup inf V{x,y,t)<6 (5.5) 

{x,y)e{B{p)\{0})xB{p) <e[0,l] 

and 

sup inf V{x,y,t)<6. (5.6) 

{{a;,y)G(R'*\r)xMd, mi^f,gc(\\y-z\\ + \\x-z\\)<p} *e[0,l] 

For the next lemmas, we define 

ap := inf{t > : e B{p) U dG}. 

The second lemma gives a uniform lower bound on the probability of an exit from G 
starting from a small sphere around before hitting an even smaller sphere. 

Lemma 5.3 Assume (H) and (Ha-e). Then 

limliminfeln inf P„(X^ e dG) > -V . 

p^O e^O j/gS{2p) " 

The following upper bound relates the quasi-potential 1^(0, •) with the probability that an 
excursion starting from a small sphere around hits a given subset of dG before hitting 
an even smaller sphere. 

Lemma 5.4 Assume (H) and (Ha-f). For any closed set N C dG, 

limlimsupeln sup Fy{X^ e iV) < - inf V{0,z) 

The last lemma is used to extend the previous upper bound to any initial condition x € G. 
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Lemma 5.5 Assume (H) and (Ha). For every p > such that B{p) C G and all x £ G, 



limP,(X^^ G B{p)) = 1. 

The statements of Lemmas 15.21 15.41 and 15.51 are the same as Lemmas 5.7.8, 5.7.21 
and 5.7.22 of p2|, respectively. Among them, Lemmas 15.41 and 15.51 can be deduced from 
Corollary 14.41 exactly as in [12], so we omit their proof. Because of the degeneracy of 
at 0, Lemma EH must be proved with a different method. Finally, Lemma [531 replaces 
Lemma 5.7.18 of [12] and is very different since it gives no upper control on . This lemma 
and the proof of Theorem 15.11 (b) are the new part of our proof. 

Theorem 15.11 (a) can be proved exactly as the corresponding inequalities in Theo- 
rem 5.7.11 and Corollary 5.7.16 of [T^. It makes use of our Lemmas 15.21 15.41 and 15.51 and 
of Lemmas 5.7.19 and 5.7.23 of [12], which can be proved exactly as therein. One simply 
must take care that x belongs to G \ {0} instead of G. Let us omit this proof. 

We first give the proof of Theorem 15.11 (b) and next those of Lemmas 15.21 and 15.31 



Proof of Theorem 15.11 (b) Let p > he small enough to have B{2p) C G (the precise 
choice of p will be specified later). Let = and for m = 0, 1, . . . define the stopping 
tiniGS 

Tm = inf{t > 9m ■■ Xt G B{p) U dG}, 
e,n+i = inf{t > : G S{2p)}, 

with the convention that 9m+i = oo if X^^ G dG. Each interval [Tm,Tm+i] represents one 
significant excursion off B{p). Note that, necessarily, = for some integer m. 

First, Assumption (He) implies that 9m+i < c)o as soon as X^^^^ G B{p). This can be 
proved as follows. 

On the one hand. Assumption (He) implies that, for all x G S{p), 

lim P^(limsup \\Xf\\ > a) = 1. (5.8) 

On the other hand, for any a > 0, X^ is a diffusion with bounded drift part and uniformly 
non-degenerate diffusion part in B{2p) n Ta/2- Therefore, has a uniformly positive 
probability to reach S{2p) before S{a/2) starting from any point of S{a). Hence, by the 
strong Markov property of Proposition 13.31 for all x G S{p), 

F^{9i < oo I Umsup \\Xf\\ > a) = I. 

Combining this with (|5.8p we have that Fx{9i < oo) = 1 for all x G S{p), which implies 
the required result. 

Second, fix a closed set C G such that Vjy := inf^gAr V{0, z) > V . Assume Vn < oo 
(otherwise, Vn may be replaced by any arbitrary large constant in the proof below). Fix 
r] > such that r] < {Vjy — V)/3. Applying Lemmas 15.31 and 15.41 we fix p > and eo > 
such that 

inf Fy(X^^ G dG) > e-(^+^)/^ Ve < eo (5.9) 

and 

sup Fy{X^^ e N)< e~^^^-iy^, Ve < eo- 
yeSi2p) " 
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Fix y G B{p). For any / > 1, we have 

I 

^y{X'r. eN)< ¥y{T' >ri)+Y, ^y{r' = Tm and X^. G N). (5.10) 

m=l 

The second term can be bounded as follows: for m > 1, y G B{p) and e < Sq, it follows 
from the strong Markov property that 

Py(T" = and X^. G iV) = ¥y{T' > 7:^_i)Pj,(X^,^ G | > r,„_i) 

= ¥y{T' > r„_i)Ej,[Px| (X^ G iV) I > r„_i] 

< sup P^(X^ G TV) < e-(^^-^)/^ 
xes(2p) 

Concerning the first term of the right-hand side of (IS.lOp . for any I > 1 and y G B{p), 
Py(r" > ri) = Ey[Fxi (r' > n^i)] < sup P,(r^ > r,_i), 

^ xG5(2p) 

and, for any x G 5'(2/7) and > 1, 

^x{t' > Tk) = [1 - P^(r^ = Tfc I > rfc_i)]P^(T" > r^^i) 

= [1 - E,[Px|^ (X^^ G aC) I t' > n-i]]¥,{T' > Tk-i) 

where q := miy^s{2p) ^y(.X'^, G dG) > e-(^+'')/^ by (ES]). Therefore, 

sup P,(r^ > Tfc) < (1 - g)^ 

yGS{2p) 

Putting together these estimates in (|5.10|) . we obtain that, for all y £ B{p) and e < Eq 

Py(X^. G iV) < (^1 -e-— j +le —. 

We choose / = [2e[^"^^'')/'^J , where [-J denotes the integer part function. Then, for e small 
enough, I -1 > e^^+^'^^Z^ and 

Py(X^. GiV) < M j +2e 1 , 

where := e^^^''^/^. Since ^ +cxd, we have (1 — l/ne)"^ ^ 1/e, and, finally. 



hm sup Py(X^. G AT) = 0. 

The proof of (15.31) is now completed by combining Lemma 15.51 and the inequality 

P,.(X^. G iV) < P.(X^ ^B{p))+ sup Pj,(X^. G iV). 

Applying (15.3(1 to = {z G : ||z — 2;*|| > 5} and observing that Lemma [5?2l implies 
the continuity of z i— > F(0, z) on (9G, we easily obtain (|5.4p . □ 
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Proof of Lemma 15.21 (15.51) Fix 6,p > 0, x e B{p) \ {0} and y G B{p). In order to 
simplify the notations, we will use the complex notation for the coordinates of points of the 
(two-dimensional) plane of containing 0, x and y, and we will assume that x = r G M 
and y = r'e*^, with < r < p and < r' < p. Define ip G C([0, l],B{p)) by 

r (1 - (3t)2)r + (3t)2p if < i < 1/3 

ip{t) = I pe^m-^) if 1/3 < t < 2/3 

\ (1 - (3 - 3t)2)r'e*^ + (3 - 3tfpe''^ if 2/3 < t < 1. 

Then -0(0) = x and -0(1) = and il){t) G -B(p) \ {0} for any t G [0,1). Moreover, for 
< t < 1/3, %lj{t) = r + 9t'^{p - r), so that \\ij{t)\\ > 9t'^{p - r), and, similarly, for 
2/3 < t < 1, ||?/'(i)|| > 9(1 — t)^(/0 — r'). Thanks to assumption (He), a calculation similar 
to equation (|4.8p in the proof of Proposition 14.51 gives that, with the same K, A/q and oq 
as therein, if B{p) C A/q, 



2ao 



10 



+ 



+ 



1/3 ¥m\ 

1 2{18{l - t){p - r')y + 2K^ 

2/3 




1/3 1-2/3 

{6i8{p-r) + 2K^\\ij{t)\\)dt+ / {186^ + 2K^)pdt 

Jl/3 



1 

2| 



< 



+ / (648(p-r') + 2K2||^(^)||)^^ 

J2/3 J 

(216 + 2K^/3)p + (602 ^ 2K^/3)p + (216 + 2i^V3)/0 

2ao 



Consequently, for sufficiently small p > not depending on x and y, h^xii^) < <J/2, which 
yields ([53]l . □ 



Proof of Lemma 15.21 (I5.6p Fix 5 > 0. Thanks to Assumption (He), using the same 
method as above, for any z G dG n F, one can find a positive pz such that 

sup inf Vix,y,t) < 6/2, (5.11) 

{x,y)&{B{z,p,)\{Q})xBiz,p,) tG[0,l] 

where B{z,r) is the closed ball centered at z with radius r 

Let po be the infimum of pz for z G (?G H F. Since G is bounded, because of Assump- 
tion (Hd), this set is finite and po > 0. Reducing po if necessary, we can assume that 
B{po) c G and that d(F n (M"^ \G),G) > po. 

Fix rc and y in M*^ \ Uze^Gnr -^(-^' Po) and assume that there exists z G with 
||x — z\\ + \\y — z\\ < po/3. Then d{x,T) > 2po/3 and d{y,T) > 2po/3. Moreover, since 
\\x — y\\ < po/3, the segment [x,y] is included in Tp^/^. 



39 



Now, for any to > 0, x and y such that [x,y] C Tp^/s, define G C([0, to], IK'^) by 

V.(*o)(t)=(l-^):r+Ay 

for < t < to- Then V'^^^'Ho) = x and '0^*''''(*o) = V and '(/'^^''^(t) G Tpo/g for all t G [0,to]- 

Since a is uniformly non-degenerate on Tp^/^, there exists a constant C bounding the 
eigenvalues of on this set. Then 

C [\\x-yf . \ 
where -B is a bound for 6 on M'^. Taking Iq = \\x — y\\/ B ^ we obtain 

Therefore, there exists pi > such that inf(g[o_i] V{x,y,t) < 6/2 for any x and y such 
that [x,y] C Tp^/s and \\x — y\\ < pi. In view of (|5.11ll . p = pi A {po/3) is an appropriate 
constant in (|5.6p . □ 

Proof of Lemma 15.31 Fix ry > and let p > be small enough to have B{2p) C G and 
for Lemma [5^2] to hold with 5 = r//3 and 2/9 instead of p. Note that the definition of It^x 
implies the inequality infj^g5(2p) ^{y-,^) ^ ^(0, as soon as z B{2p). 

Then, by (|5.6I) and Assumption (Hb), there exists x S S{2p), z ^ G, Ti < oo and 
V' G C([0,ri],M'^) such that -0(0) = x, '^(Ti) = z and /ti,x(^) < + r//3. Moreover, 
by removing the beginning of the path ^p until the last time where it hits S{2p), we can 
suppose that for all t > 0, ■0(t) B{2p). 

Thanks to (15. Sp . for any y G S{2p), there exists a continuous path V'^ of length ty < 1 
such that V'^(O) = y, tp^{ty) = x, and Ity,yiip^) < ry/3. Moreover, the construction of 
this function in the proof of Lemma [52] allows us to assume that HV'^l*)!! = 2/9 for all 
t £ [0,ty]. Let (py denote the path obtained by concatenating ^py and ip (in that order) 
and extending the resulting function to be of length To = Ti + 1 by following (|5.ip after 
reaching z. Since the latter path does not contribute to the rate function, we obtain that 
iTo,ym<V + '^Vl3. 

Since z G \ G, the constant A := d{z, dG) is positive. Define 

0:= U |vGC([0,ro],M'^), ||^-,/)^||o,To<^|. 

Observe that O is an open subset of C([0, To], M*^) that contains the functions {</*^}j/e5(2p)- 
Therefore, by Corollary 14.41 

liminfeln inf '^y{X'' O) > - sup inf /tq ylV") > - sup Ito y{(l}") > -{V + r]). 
e^O y&S(2p) yeS(2p)i'^0 ' y&S{2p) 
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If f/) G O, then reaches the open ball of radius A/2 centered at z before hitting B{p), 
so hits dG before hitting B{p). Hence, for Xq = y E S{2p), the event {X^ G O} is 
contained in {X^^ G dG}, and the proof is completed. □ 
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